v1.1.10: [v1.1.10] Bug Fixes and diagnostic tooling

Compare Source

🔧 Improvements & Tools:

• Comprehensive Diagnostic Scripts - New debugging tools for Linux and Windows
• Network Reliability Enhancements - Better retry logic for I/O errors
• Simplified DNS resolution to run in Kubernetes environments
• CAS API Path Modernization - Updated to use plural nouns following REST conventions

🐛 Bug Fixes:

• Chunker Boundary Triggering Fix - Fixed deduplication consistency issues
• WASM First Chunk Dedup Handling - Improved client-side control
• Data Type Safety Enhancements - Standardized on u64 for cross-platform compatibility

What's Changed

• Add input params to Run name in GH Workflow UI by @​rajatarya in #​478
• Thin wasm: do not automatically set is_dedup to true for first chunk by @​coyotte508 in #​481
• update api paths to use plural nouns by @​assafvayner in #​482
• Rename xet_threadpool to xet_runtime to reflect usage by @​hoytak in #​484
• use u64 rather than usize in file hashing paths by @​assafvayner in #​485
• Git-Xet: LFS custom transfer agent with Xet protocol by @​seanses in #​425
• Drop "GaiResolverWithAbsolute" by @​seanses in #​486
• Fix wheel upload for linux for dev/alpha/beta tags by @​hoytak in #​379
• Adding retry for unhandled io errors when sending requests by @​jgodlew in #​468
• Updated chunker to eliminate spurious boundary triggering. by @​hoytak in #​487
• Diagnostic Scripts + README changes by @​rajatarya in #​489
• hf_xet 1.1.10 by @​assafvayner in #​490

Full Changelog: huggingface/xet-core@v1.1.9...v1.1.10

v1.1.9: [v1.1.9] Bug Fixes: Parallelism optimizations, metadata updates

Compare Source

🚀 Performance Improvements:
• Improve parallelism in parutils by removing async_scoped
• Increase soft file limits for MacOS

🐛 Bug Fixes:
• Update hf_xet PyPI metadata

🔧 Reliability & Maintenance:
• Improved debuggability with tokio console support
• Add CI builds for MacOS

What's Changed

• parutils makeover remove async_scoped by @​assafvayner in #​454
• tokio console setup by @​assafvayner in #​458
• enforce linting on hf_xet by @​assafvayner in #​462
• Raise soft file handle limits to hard limits on OSX. by @​hoytak in #​453
• run_and_extract_custom: remove use of explicit tokio_retry without utility by @​assafvayner in #​460
• Use a valid SPDX identifier as license classifier by @​ecederstrand in #​464
• CI test on macos by @​seanses in #​473
• Update PyPI package metadata for hf-xet by @​rajatarya in #​472
• Update hf_xet/README.md for hf_xet project by @​rajatarya in #​475
• Bumping version to 1.1.9 by @​rajatarya in #​476

New Contributors

• @​ecederstrand made their first contribution in #​464

Full Changelog: huggingface/xet-core@v1.1.8...v1.1.9

v1.1.8: Bug Fixes

Compare Source

🚀 Performance Improvements:
• Client Caching - Reuses reqwest Client across RemoteClient objects to share connection pools
• Connection Limits - Limits idle connections to prevent resource exhaustion

🐛 Bug Fixes:
• Singleflight Fix - Critical fix preventing permanent error caching when owner tasks are dropped
• DataHash Serialization - Ensures consistent little-endian byte order across platforms

🔧 Reliability & Maintenance:
• Retry Logic Restoration - Restores retry logic accidentally removed in versions 1.1.6 and 1.1.7

What's Changed

• fix: singleflight owner task not removing Call from Group if dropped by @​jgodlew in #​447
• Add back retry for connection setup and sending request by @​seanses in #​455
• Fix DataHash hex string serde to little endian by @​seanses in #​445
• Clean up dependencies (no functionality change) by @​seanses in #​456
• Cache and reuse reqwest Client by @​seanses in #​457
• Limit number of idle connections by @​hoytak in #​459
• update version by @​assafvayner in #​461

Full Changelog: huggingface/xet-core@v1.1.7...v1.1.8

v1.1.7

Compare Source

What's Changed

• Remove telemetry code; eliminate Mutex on logging setup. by @​hoytak in #​441
• Changed default number of parallel downloads from 64 to 48. by @​hoytak in #​442
• Updated version to v1.1.7 by @​hoytak in #​443

Full Changelog: huggingface/xet-core@v1.1.6...v1.1.7

v1.1.6: [v1.1.6] Bug Fixes: Proxy support, process safety, and more

Compare Source

✨ New Features and Improvements

• Proxy support, easing use behind corporate networks. (#​413 by @​hoytak; addresses #​400 - thanks @​albertodepaola and @​goodsonjr for the initial reports)
• Improvements to hf_xet logging; providing facility to log events to a formatted file (#​428 by @​hoytak)

🐛 Bug Fixes

• Process safety: make running after os.fork() safer. (#​429 by @​hoytak; addresses #​415 - thanks @​John6666cat for the report)
• Respect XDG_CACHE_HOME and ~/ when setting cache directories. (#​426 by @​hoytak; addresses #​417 - thanks @​half-duplex for the initial report)
• Lower the default NUM_RANGE_CONCURRENT_GETS value to 64 to better respect file descriptor limits (#​438 by @​assafvayner; addresses #​436 - thanks @​djholt and @​gary149 for the reports)
• JWT token handling hardened with a buffer before expiration. (#​405 by @​jgodlew; addresses #​404)

What's Changed

• Streaming shard interface updates by @​assafvayner in #​392
• WASM poc by @​seanses in #​272
• Generic retry wrapper to consolidate and streamline retry logic. by @​hoytak in #​397
• Fix for retry failure due to non-clonability by @​hoytak in #​402
• Adding buffer to JWT token expiration check by @​jgodlew in #​405
• Updating chunk and shard cache default sizes by @​jsulz in #​406
• Simplified Client interface. by @​hoytak in #​408
• Add correctness tests for aggregate hash functions. by @​hoytak in #​412
• Enabling proxy support for reqwest by @​hoytak in #​413
• Thin wasm by @​assafvayner in #​411
• Move MDB v1 to reference test code; add standalone hash functions by @​hoytak in #​414
• Add verification hash and file hash functions by @​assafvayner in #​416
• Use v1 api paths by @​assafvayner in #​421
• Set shard size limit as max, not target min by @​assafvayner in #​420
• Remove footer from upload shard payload by @​assafvayner in #​419
• Errors on shard reading are now logged and ignored. by @​hoytak in #​424
• Add whether chunk should be checked against global dedup by @​coyotte508 in #​423
• Logging improvements by @​hoytak in #​428
• Export hmac function in thin wasm by @​coyotte508 in #​427
• Make hf_xet fork-exec safe by @​hoytak in #​429
• Revert use of v1 api paths by @​assafvayner in #​432
• Limit number of async worker threads on large CPUs by @​hoytak in #​431
• Respect XDG_CACHE_HOME and ~/ when setting cache directory. by @​hoytak in #​426
• Associate static semaphores with runtime by @​hoytak in #​433
• Remove logging from wasm lib by @​coyotte508 in #​434

Full Changelog: huggingface/xet-core@v1.1.5...v1.1.6